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Motivated by Hall's recent comment in ^uant-ph/0007116 
we point out in some detail the essence of our reasoning why 
we believe that Shannon's information is not an adequate 
choice when denning the information gain in quantum mea- 
surements as opposed to classical observations. 

PACS number(s): 03.65.-w, 03.65. Bz, 03.67.-a 



In a recent comment [Q, Hall raises some very inter- 
esting points with respect to our recently published crit- 
icism Q of the applicability of Shannon's measure || of 
information to quantum measurement. Before answering 
some of Hall's criticism directly we would like to recall 
some of the essential points of our view: 

1) We require from an information measure appropri- 
ate to a quantum experiment that it firstly describes the 
information gain of an individual experiment and sec- 
ondly that the total information gain is described by the 
sum of a complete set of non-commuting, i.e. comple- 
mentary, observables. 

2) We require that the information gain be directly 
based on the observed probabilities, (and not, for ex- 
ample, on the precise sequence of individual outcomes 
observed on which Shannon's measure of information is 
based) . 

3) As the particular choice of the complete set of non- 
commuting observables is at the whim of the experimen- 
talist, and as the total information content of a quan- 
tum system must be independent of the experimental- 
ist's choice, we require the total information content to 
be invariant upon that choice. 

For the purpose of further discussion we denote the 
measure of information in the measurement of observ- 
able A by I(p) where p — pi,...,p n are probabilities 
for outcomes to occur. Then the total information con- 
tent of the quantum system is defined as the sum of 
individual measures of information over a complete set 
Ai, Aj, ... of mutually complementary observables, i.e. 

Itotal 

= J2j I(Pj ) where pj is the probability distribution 
observed in the measurement of observable Aj . With the 



specific measure of information I(p) (proportional to the 
sum of the squares of probabilities) that both mathemat- 
ically and conceptually differs from the Shannon measure 
the total information of the quantum system is shown to 
have the property of invariance required in 3) above . 

An essential point of our argument is that Shannon's 
measure of information is intimately tied to the notion 



of systems carrying properties prior to and independent 
of observation. This is certainly the case for classical 
systems but, in general, this is not true for quantum sys- 
tems. It is only true for quantum systems in the rare case 
of measurements performed in a basis where the density 
matrix of the system is purely diagonal. Be it a pure 
state, which is measured using an apparatus to whom 
the state is an eigenstate, or be it a mixed state, in its 
diagonal representation where the probabilities for the 
subsystems occur can be viewed as classical probabilities 
for the measurement results in that diagonal basis. 

While Hall seems to agree that Shannon's reasoning of 
breaking down a decision tree of various ways cannot be 
applied to consecutive quantum measurements for non- 
commuting observables, he suggests that this observation 
of ours is not relevant in judging whether Shannon's in- 
formation is applicable to quantum measurement. We 
note that at least one of the reasons given to justify the 
use of Shannon's information in general is therefore unap- 
plicable, yet we would suggest that we cannot agree with 
Hall's point where he criticizes our use of the Fadeev § 
form of the so-called grouping axiom. In particular he 
suggests that the grouping axiom which, we agree, di- 
rectly leads to Shannon's information can still be used 
if one considers non-overlapping distributions which are 
defined such that there exists some measurement which 
is able to discriminate between them with certainty. 

We suggest that this is exactly the case when we ob- 
serve a density matrix in its eigenbasis where it has no 
non-diagonal terms, that is, when we can indeed intro- 
duce classical probabilities. Yet, clearly, if we consider 
other observables, where the density matrix is not non- 
diagonal, we certainly arrive at states which are coherent 
superposition of the basis states and therefore if we per- 
form the measurement in this new basis the distributions 
cannot uniquely be defined. It should also be noted that 
the results observed in one single quantum measurement 
can always be assumed as emerging from a classical mix- 
ture of non-overlapping distributions with weights being 
equal to the probabilities for the results observed. Yet 
again, these distributions cannot be defined uniquely for 
all possible non-commuting measurements ||. There- 
fore, we suggest that this argument by Hall actually can 
be viewed as supporting our general proposition. 

In his comment Hall analyzes some geometrical proper- 
ties of Shannon and von Neumann entropies and he gives 
a connection between them pointing to the existence of 
a unique measure of uncertainty for classical and quan- 
tum systems with the geometrical properties of a "vol- 
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ume" IJlJjTj] . This leads him to the conclusion that the 
von Neumann entropy is in fact an appropriate quan- 
tum generalization of Shannon entropy. While it might 
be of theoretical importance to request for an adequate 
measure of information in classical and quantum physics 
certain well-defined geometrical properties, we suggest to 
judge the physical significance of a measure of informa- 
tion by its operational properties because after all every 
information about the system is obtained at only by ob- 
servation. 

Following this requirement we argue that, with the 
only exception for results of measurement in a basis de- 
composing the density matrix into a classical mixture 
when it is equivalent to Shannon's information and there- 
fore indeed refers to the information gain in an individual 
measurement experiment, the von Neumann entropy is 
just a measure of the purity of the given density matrix 
without any explicit reference to information contained 
in individual measurements. 

Hall argued that this kind of criticism also holds for 
our proposed total information content because for the 
measurement in the basis in which the density matrix is 
diagonal the measure of information I(p) is equal to the 
total information Itotai (p) ■ We emphasize that for a com- 
plete set of mutually complementary observables, thus 
including also those for which the density matrix cannot 
be decomposed into a classical mixture, and furthermore 
without knowledge of the basis in which the density ma- 
trix is diagonal, we always have Itotal(p) = in 
contrary there is no such relation for the von Neumann 
entropy and the set of individual Shannon's measures as- 
sociated to mutually complementary measurements. The 
case of I(p) = Itotai(p) is just an extreme one of maximal 
knowledge of one observable at the expense of complete 
ignorance of complementary ones, however the value of 
the total information remains unchanged also for other 
choices of a complete set of observables where we have 
only partial knowledge of them. 

In relation to Hall's argument mentioned above, it 
might be of interest that besides the discussed case of the 
measurement in the basis in which the density matrix is 
diagonal there exists an infinitely large set of individual 
measurements for all of which the measure of informa- 
tion is indeed equal to the total information content. We 
explain this on the simple example of a spin-1/2 particle 
for which we know to have three mutually complemen- 
tary measurements. These are the measurements of spin 
along orthogonal directions x 1 , x 2 and a; 3 . From the three 
von Neumann measurements we may formally constitute 
one single measurement with 6 outcomes described by a 
POVM 



^E|x J )(x J 



|-x J ')(-x J | = i. 



(1) 



pleteness relations. From this one single POVM we ob- 
tain 6 probabilities. Inserting them in the expression for 
our measure of information we get a quantity which is 
invariant under unitary transformation. We find it in- 
triguing that just from one single POVM experiment we 
can obtain the total information of the quantum system 
which comprises in itself all possible mutually comple- 
mentary classes of information. 

Hall also suggests that the von Neumann can be viewed 
as an operational concept as it is based on probabilities. 
We remark that the usual procedure to obtain the von 
Neumann entropy includes performance of the sufficient 
number of measurements necessary for complete specifi- 
cation of the density matrix, calculation of its elements 
using a very specific and well-defined prescription from 
quantum theory that connects probabilities observed in 
the measurements and complex elements of the density 
matrix, and finally performing a particular mathemati- 
cal operation In the formulation of our information con- 
tent we were lead by an operationally based plausible 
idea that in quantum mechanics an experimentalist can 
have only partial knowledge about mutually exclusive 
measurements in general without any further reference 
to the structure of the theory. By simple summarizing 
these partial knowledges we obtain immediately a quan- 
tity which turns out to be invariant under unitary trans- 
formation in contrast to the procedure mentioned above 
where one has to use concepts from quantum theory from 
the beginning. 

Finally Hall makes the interesting suggestion of defin- 
ing our new measure of information not only via complete 
sets of mutually complementary observables but by an 
average over all non-degenerate Hermitian observables. 
This apparently is a nice generalization independent of 
the question whether or not a complete set of mutually 
complementary observables exists for Hilbert spaces of 
any dimension. 
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This is just the properly normalized sum of three com- 
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